A Survey on Task Assignment in Crowdsourcing
نویسندگان
چکیده
Quality improvement methods are essential to gathering high-quality crowdsourced data, both for research and industry applications. A popular broadly applicable method is task assignment that dynamically adjusts crowd workflow parameters. In this survey, we review address: heterogeneous assignment, question plurality problems in crowdsourcing. We discuss contrast how these estimate worker performance, highlight potential challenges their implementation. Finally, future directions methods, crowdsourcing platforms other stakeholders can benefit from them.
منابع مشابه
Task Assignment on Spatial Crowdsourcing (Technical Report)
Recently, with the rapid development of mobile devices and the crowdsourcing platforms, the spatial crowdsourcing has attracted much attention from the database community. Specifically, spatial crowdsourcing refers to sending a location-based request to workers according to their positions, and workers need to physically move to specified locations to conduct tasks. Many works have studied task...
متن کاملMotivation-Aware Task Assignment in Crowdsourcing
We investigate how to leverage the notion of motivation in assigning tasks to workers and improving the performance of a crowdsourcing system. In particular, we propose to model motivation as the balance between task diversity–i.e., the difference in skills among the tasks to complete, and task payment–i.e., the difference between how much a chosen task offers to pay and how much other availabl...
متن کاملOnline Task Assignment in Crowdsourcing Markets
We explore the problem of assigning heterogeneous tasks to workers with different, unknown skill sets in crowdsourcing markets such as Amazon Mechanical Turk. We first formalize the online task assignment problem, in which a requester has a fixed set of tasks and a budget that specifies how many times he would like each task completed. Workers arrive one at a time (with the same worker potentia...
متن کاملSkill-Aware Task Assignment in Crowdsourcing Applications
Besides simple human intelligence tasks such as image labeling, crowdsourcing platforms propose more and more tasks that require very specific skills. In such a setting we need to model skills that are required to execute a particular job. At the same time in order to match tasks to the crowd, we have to model the expertise of the participants. We present such a skill model that relies on a tax...
متن کاملTask Routing and Assignment in Crowdsourcing based on Cognitive Abilities
Appropriate task routing and assignment is an important, but often overlooked, element in crowdsourcing research and practice. In this paper, we explore and evaluate a mechanism that can enable matching crowdsourcing tasks to suitable crowd-workers based on their cognitive abilities. We measure participants’ visual and fluency cognitive abilities with the well-established Kit of FactorReference...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: ACM Computing Surveys
سال: 2022
ISSN: ['0360-0300', '1557-7341']
DOI: https://doi.org/10.1145/3494522